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DETAILED ACTION 

i 

Response to Amendment 

1. In response to the office action from 2/28/2005, the applicant has submitted an 
amendment, filed 3/23/2005, amending claims 1, 4, 6, 8-10, 12-14, 20-21, and 24, while arguing 
to traverse the art rejection based on the limitation regarding an image recognition means for 
determining the contents of a road sign image (Amendment, Pages 11-12). The applicant's 
arguments have been fully considered but are moot with respect to the new grounds of rejection 
in view of Van Ryzin (U.S. Patent: 5,844,505) in view of Martino et al (U.S. Patent: 
6,061,646). 

2. Due to the translated foreign priority papers of JP 2000-1 14244, filed on 1 1/5/2004, the 
examiner has withdrawn the prior art rejections with relying on Ito (U.S. Patent: 6,243,675). 

Claim Objections 

3. Claims 8-10, 14, and 16 are objected to because of the following informalities: 

In Claim 8, Line 3, Claim 9, Line 3, Claim 10, Line 3, Claim 14, Line 3, "the language" 
should be changed to —a language--, in order to provide proper antecedent basis. 
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In Claim 8, Line 6, Claim 9, Line 6, Claim 10, Line 6, Claim 14, Line 6, Claim 16, Lines 
4-5, and Claim 16, Line 7, "the contents" should be changed to -contents-, in order to provide 
proper antecedent basis. 

Appropriate correction is required. 

Claim Rejections - 35 USC §103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

5. Claims 1-6, 9-13, 16, and 20-26 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Van Ryzin (U.S. Patent: 5 ,844 ,5 05) in view of Martino et al (U.S. Patent: 
6,061,646) 

With respect to Claim 1, Van Ryzin discloses a vehicle navigation system and method 
utilizing a camera for performing image recognition on road signs for display to a driver (Fig. 1, 
Elements 12 and 20; Col. 3, Line 9- Col. 4, Line 22). 

Although Van Ryzin suggests the use of speech recognition with a vehicle navigation 
device (Col. 3, Lines 36-44), Van Ryzin does not teach performing speech recognition to identify 
a user language in order to format a display output in the user's language, however Martino 
teaches a device and method that recognizes a user's speech, makes a language determination, 
and then supplies requested data to a user on a display in the spoken language (language 
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identification,' Col 2, Lines 21-37; Col. 5, Lines 11-23; and display formatted in a spoken user 
language, Col 11, Lines 15-24), 

Van Ryzin and Martino are analogous art because they are from a similar field of 
endeavor in information providing interface systems. Thus, it would have been obvious to a 
person of ordinary skill in the art, at the time of invention, to modify the teachings of Van Ryzin 
with the language identification means taught by Martino to implement a multilingual 
information providing system enabling speakers of various languages to communicate with the 
device (Martino, Col. 1, Lines 36-38). 

With respect to Claim 2, Van Ryzin discloses: 

The navigation processing means includes map-displaying means for displaying map 
information showing a vicinity of a vehicle (Col. 3, Lines 48-65). 

Additionally, Martino teaches the language identification means for formatting a display 
output in a speaker's language as applied to claim 1. 

With respect to Claim 3, Van Ryzin discloses: 

The navigation processing means includes route-searching means for searching for a 
route to a destination and route-guiding means for guiding a vehicle by means of guiding speech 
along a route set by the route searching means (Col 3, Line 48- Col. 4, Line 17). 

Additionally, Martino teaches the language identification means for formatting a display 
or audio output in a speaker's language (Col 11, Lines 15-24). 

With respect to Claim 4, Martino further teaches identifying the speaker's language as 
the language having the greatest number of hits resulting from a dictionary search (Col 9, Lines 
44-53; Col 10, Lines 58-65). 
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With respect to Claim 5, Martino further discloses: 

A database for storing features of a speaker's language as extracted by the language 
determining means (language recognition dictionaries, Col. 9, Lines 14-27); and 

The speaker's language is determined individually (language recognition dictionaries 
accounting for speaker variation, CoL 9, Lines 14-43), 

With respect to Claim 6, Van Ryzin teaches the image recognition means, as applied to 
Claim 1, for outputting a captured image of a road sign on a user display, while Martino teaches 
the language identification means for formatting a display output in a speaker's language as 
applied to claim 1 . 

With respect to Claim 9, Van Ryzin discloses a vehicle navigation system and method 
utilizing a camera for performing image recognition on road signs for a text image display to a 
driver (Fig. 1, Elements 12 and 20; Col. 3, Line 9- Col. 4, Line 33). Van Ryzin further teaches 
the use of a microphone for receiving a speech input (Col 3, Lines 36-48) and outputting guiding 
data in an audio format (CoL 3, Line 66- Col. 4, Line 46). 

Although Van Ryzin suggests the use of speech recognition with a vehicle navigation 
device (Col. 3, Lines 36-44), Van Ryzin does not teach performing speech recognition to identify 
a user language in order to format a display output in the user's language or an identity learning 
unit for computing a frequency of languages, however Martino teaches a device and method that 
recognizes a user's speech, makes a language determination, and then supplies requested data to 
a user on a display in the spoken language (language identification, Col 2, Lines 21-37; Col. 5, 
Lines 11-23; and display formatted in a spoken user language, Col 11, Lines 15-24). Martino 
further teaches a language identification system that "compares each source word with all the 
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common words in all Word Frequency Tables (WFTs)" (Col 10, Lines 30-32) associated with 
different languages, updates Word Frequency Accumulators (WFAs) for each language and once 
the processing of the document is finished, picks the language with the highest WFA value (Col. 
11, Lines 1-4; and FIG. 2). The WFA are stored in "storage medium" (Column 1 1, Lines 14-17) 
that could be a database or memory. Martino also provides a means for determining the 
language of a text unit (Col. 10, Lines 19-65). 

Van Ryzin and Martino are analogous art because they are from a similar field of 
endeavor in information providing interface systems. Thus, it would have been obvious to a 
person of ordinary skill in the art, at the time of invention, to modify the teachings of Van Ryzin 
with the language identification means taught by Martino to implement a multilingual 
information providing system enabling speakers of various languages to communicate with the 
device (Martino, Col. 1, Lines 36-38). 

With respect to Claim 10, Van Ryzin discloses a vehicle navigation system and method 
utilizing a camera for performing image recognition on road signs for display to a driver (Fig. 1, 
Elements 12 and 20; Col. 3, Line 9- Col. 4, Line 22). Van Ryzin further teaches the use of a 
microphone for receiving a speech input (Col. 3, Lines 36-48). 

Although Van Ryzin suggests the use of speech recognition with a vehicle navigation 
device (Col 3, Lines 36-44), Van Ryzin does not teach performing speech recognition to identify 
a user language in order to format a display output in the user's language or an identity learning 
unit for computing a frequency of languages, however Martino teaches a device and method that 
recognizes a user's speech, makes a language determination, and then supplies requested data to 
a user on a display in the spoken language (language identification, Col 2, Lines 21-37; Col. 5, 
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Lines 11-23; and display formatted in a spoken user language, Col 11, Lines 15-24). Martino 
further teaches a language identification system that "compares each source word with all the 
common words in all Word Frequency Tables (WFTs)" (Col 10, Lines 30-32) associated with 
different languages, updates Word Frequency Accumulators (WFAs) for each language and once 
the processing of the document is finished, picks the language with the highest WFA value (Col. 
11, Lines 1-4; and FIG. 2). The WFA are stored in "storage medium" (Column 11, Lines 14-17) 
that could be a database or memory. Martino also provides a means for determining the 
language of a text unit (Col. 10, Lines 19-65). 

Van Ryzin and Martino are analogous art because they are from a similar field of 
endeavor in information providing interface systems. Thus, it would have been obvious to a 
person of ordinary skill in the art, at the time of invention, to modify the teachings of Van Ryzin 
with the language identification means taught by Martino to implement a multilingual 
information providing system enabling speakers of various languages to communicate with the 
device (Martino, Col. 1, Lines 36-38). 

With respect to Claim 11, Van Ryzin discloses outputting guiding data in an audio 
format (Col. 3, Line 66- Col. 4, Line 46). 

With respect to Claim 12, Van Ryzin teaches the image recognition means, as applied to 
Claim 10, for outputting a captured image of a road sign on a user display, while Martino teaches 
the language identification means for formatting a display output in a speaker's language as 
applied to claim 10. 

With respect to Claim 13, Van Ryzin discloses: 
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The guiding sign generating unit generates the guiding image without replacing the 
language of the character strings (Fig. 1 and Fig. 2A-C). 

With respect to Claim 16, Van Ryzin discloses a vehicle navigation system and method 
utilizing a camera for performing image recognition on road signs for display to a driver (Fig. 1, 
Elements 12 and 20; Col. 3, Line 9- Col. 4, Line 22). 

Although Van Ryzin suggests the use of speech recognition with a vehicle navigation 
device (Col. 3, Lines 36-44), Van Ryzin does not teach performing speech recognition to identify 
a user language in order to format a display output in the user's language, however Martino 
teaches a device and method that recognizes a user's speech, makes a language determination, 
and then supplies requested data to a user on a display in the spoken language (language 
identification, Col 2, Lines 21-37; Col. 5, Lines 11-23; and display formatted in a spoken user 
language, Col. 11, Lines 15-24). 

Van Ryzin and Martino are analogous art because they are from a similar field of 
endeavor in information providing interface systems. Thus, it would have been obvious to a 
person of ordinary skill in the art, at the time of invention, to modify the teachings of Van Ryzin 
with the language identification means taught by Martino to implement a multilingual 
information providing system enabling speakers of various languages to communicate with the 
device (Martino, Col 1, Lines 36-38), 

With respect to Claim 20, Van Ryzin discloses a vehicle navigation system and method 
utilizing a camera for performing image recognition on road signs for display to a driver (Fig. 1, 
Elements 12 and 20; Col. 3, Line 9- Col. 4, Line 22). Van Ryzin additionally teaches generating 
guiding speech for vehicle navigation (Col. 3, Line 48- Col 4, Line 17). 



Application/Control Number: 09/832,645 Page 9 

Art Unit: 2655 

Although Van Ryzin suggests the use of speech recognition with a vehicle navigation 
device (Col 3, Lines 36-44), Van Ryzin does not teach performing speech recognition to identify 
a user language in order to format a speech output in the user's language, however Martino 
teaches a device and method that recognizes a user's speech, makes a language determination, 
and then supplies requested data to as a speech output in the user's language (language 
identification, Col. 2, Lines 21-37; Col. 5, Lines 11-23; and speech formatted in a spoken user 
language, Col 11, Lines 15-24). 

Van Ryzin and Martino are analogous art because they are from a similar field of 
endeavor in information providing interface systems. Thus, it would have been obvious to a 
person of ordinary skill in the art, at the time of invention, to modify the teachings of Van Ryzin 
with the language identification means taught by Martino to implement a multilingual speech 
dialogue system enabling speakers of various languages to communicate with the device 
(Martino, Col. 1, Lines 36-38). 

With respect to Claim 21, Van Ryzin discloses a vehicle navigation system and method 
utilizing a camera for performing image recognition on road signs for display to a driver (Fig. 1 , 
Elements 12 and 20; Col. 3, Line 9- Col. 4, Line 22). 

Although Van Ryzin suggests the use of speech recognition with a vehicle navigation 
device (Col 3, Lines 36-44), Van Ryzin does not teach performing speech recognition to identify 
a user language in order to format a display output in the user's language, however Martino 
teaches a device and method that recognizes a user's speech, makes a language determination, 
and then supplies requested data to a user on a display in the spoken language (language 
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identification, Col. 2, Lines 21-37; Col. 5, Lines 11-23; and display formatted in a spoken user 
language, Col. 11, Lines 15-24), 

Van Ryzin and Martino are analogous art because they are from a similar field of 
endeavor in information providing interface systems. Thus, it would have been obvious to a 
person of ordinary skill in the art, at the time of invention, to modify the teachings of Van Ryzin 
with the language identification means taught by Martino to implement a multilingual 
information providing system enabling speakers of various languages to communicate with the 
device (Martino, Col. 1, Lines 36-38). 

With respect to Claim 22, Martino teaches the display as applied to Claim 21. 

With respect to Claim 23, Martino teaches providing a speech output in the language of a 
user as applied to Claim 20. 

With respect to Claim 24, Van Ryzin discloses a vehicle navigation system and method 
utilizing a camera for performing image recognition on road signs for display to a driver, which 
would output the characters of the road sign image when the language in the image match a 
user's language (Fig. 1, Elements 12 and 20; Col. 3, Line 9- Col. 4, Line 22). 

Although Van Ryzin suggests the use of speech recognition with a vehicle navigation 
device (Col. 3, Lines 36-44), Van Ryzin does not teach performing speech recognition to identify 
a user language in order to format a display output in the user's language, however Martino 
teaches a device and method that recognizes a user's speech, makes a language determination, 
and then supplies requested data to a user on a display in the spoken language (language 
identification, Col. 2, Lines 21-37; Col 5, Lines 11-23; and display formatted in a spoken user 
language, Col. 11, Lines 15-24). 
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Van Ryzin and Martino are analogous art because they are from a similar field of 
endeavor in information providing interface systems. Thus, it would have been obvious to a 
person of ordinary skill in the art, at the time of invention, to modify the teachings of Van Ryzin 
with the language identification means taught by Martino to implement a multilingual 
information providing system enabling speakers of various languages to communicate with the 
device (Martino, Col 1, Lines 36-38). 

With respect to Claim 25, Martino teaches providing a speech output in the language of a 
user as applied to Claim 20. 

With respect to Claim 26, Martino teaches the display as applied to Claim 24. 

6. Claims 7-8, 14-15, and 17-19 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Van Ryzin in view of Martino et al, and further in view of Ashby et al (U.S. Patent: 
6,081,803). 

With respect to Claim 7, Van Ryzin in view of Martino teaches the navigation system 
capable of outputting a road sign image in the language of a user, as applied to Claim 1 . Van 
Ryzin in view of Martino does not specifically teach a means for requesting and downloading 
navigation related data, however Ashby teaches a client-server environment for acquiring 
navigation data, where it will necessarily have the transmission means for sending and 
downloading information (Col 20, lines 18- 25). 

Van Ryzin, Martino, and Ashby are analogous art because they are from a similar field of 
endeavor in information providing interface systems. Thus, it would have been obvious to a 
person of ordinary skill in the art, at the time of invention, to modify the teachings of Van Ryzin 
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in view of Martino with the client-server environment taught by Ashby in order to provide the 
benefit of storing an increased amount of navigation data on a remote network device (Ashby, 
Col 3, Lines 5-14), thus increasing the amount of navigation data that is accessible to a user. 

With respect to Claim 8, Van Ryzin discloses a vehicle navigation system and method 
utilizing a camera for performing image recognition on road signs for display to a driver (Fig. 1, 
Elements 12 and 20; Col. 3, Line 9- Col. 4, Line 22). Van Ryzin further teaches the use of a 
microphone for receiving a speech input (Col. 3, Lines 36-48). 

Although Van Ryzin suggests the use of speech recognition with a vehicle navigation 
device (Col 3, Lines 36-44), Van Ryzin does not teach performing speech recognition to identify 
a user language in order to format a display output in the user's language or an identity learning 
unit for computing a frequency of languages, however Martino teaches a device and method that 
recognizes a user's speech, makes a language determination, and then supplies requested data to 
a user on a display in the spoken language (language identification, Col 2, Lines 21-37; Col. 5, 
Lines 11-23; and display formatted in a spoken user language, Col 11, Lines 15-24). Martino 
further teaches a language identification system that "compares each source word with all the 
common words in all Word Frequency Tables (WFTs)" (Col 10, Lines 30-32) associated with 
different languages, updates Word Frequency Accumulators (WFAs) for each language and once 
the processing of the document is finished, picks the language with the highest WFA value (Col. 
11, Lines 1-4; and FIG. 2). The WFA are stored in "storage medium" (Column 11, Lines 14-17) 
that could be a database or memory. Martino also provides a means for determining the 
language of a text unit (Col 10, Lines 19-65). 



Application/Control Number: 09/832,645 Page 13 

Art Unit: 2655 

Van Ryzin and Martino are analogous art because they are from a similar field of 
endeavor in information providing interface systems. Thus, it would have been obvious to a 
person of ordinary skill in the art, at the time of invention, to modify the teachings of Van Ryzin 
with the language identification means taught by Martino to implement a multilingual 
information providing system enabling speakers of various languages to communicate with the 
device (Martino, Col 1, Lines 36-38). 

Van Ryzin in view of Martino does not specifically teach a means for displaying a map 
image nor a means for reading map data from a storage medium, however As per claim 9, Ashby 
discloses a navigation system having language-determining means (Col. 19, Lines 6-12), a disk- 
reading device (CD-ROM, Col. 5, Lines 22-25), map reading device (18, FIG. 2, Col. 19, Lines 
33-43), intersection guiding unit (maneuver generation function, 32, FIG. 2), display (27, FIG. 
1), audio unit (29, FIG. 1), and a processor (map control unit) capable of accessing maps in 
memory buffer (RAM, 20, FIG. 1) and non-volatile memory (16, FIG. 1 and 30, FIG. 1). 

Van Ryzin, Martino, and Ashby are analogous art because they are from a similar field of 
endeavor in information providing interface systems. Thus, it would have been obvious to a 
person of ordinary skill in the art, at the time of invention, to modify the teachings of Van Ryzin 
in view of Martino with the map reading means taught by Ashby in order to provide geographic 
map images as additional data in determining an optimum driving route (Ashby, Col 1, Lines 15- 
37; Col 2, Line 61- Col 3, Line 19). 

With respect to Claim 14, Van Ryzin discloses a vehicle navigation system and method 
utilizing a camera for performing image recognition on road signs for display to a driver (Fig. 1, 
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Elements 12 and 20; Col. 3, Line 9- Col 4, Line 22). Van Ryzin further teaches the use of a 
microphone for receiving a speech input (Col. 3, Lines 36-48). 

Although Van Ryzin suggests the use of speech recognition with a vehicle navigation 
device (Col 3, Lines 36-44), Van Ryzin does not teach performing speech recognition to identify 
a user language in order to format a display output in the user's language or an identity learning 
unit for computing a frequency of languages, however Martino teaches a device and method that 
recognizes a user's speech, makes a language determination, and then supplies requested data to 
a user on a display in the spoken language (language identification, Col. 2, Lines 21-37; Col 5, 
Lines 11-23; and display formatted in a spoken user language, Col 11, Lines 15-24). Martino 
further teaches a language identification system that "compares each source word with all the 
common words in all Word Frequency Tables (WFTs)" (Col 10, Lines 30-32) associated with 
different languages, updates Word Frequency Accumulators (WFAs) for each language and once 
the processing of the document is finished, picks the language with the highest WFA value (Col. 
11, Lines 1-4; and FIG. 2). The WFA are stored in "storage medium" (Column 11, Lines 14-17) 
that could be a database or memory. Martino also provides a means for determining the 
language of a text unit (Col 10, Lines 19-65). 

Van Ryzin and Martino are analogous art because they are from a similar field of 
endeavor in information providing interface systems. Thus, it would have been obvious to a 
person of ordinary skill in the art, at the time of invention, to modify the teachings of Van Ryzin 
with the language identification means taught by Martino to implement a multilingual 
information providing system enabling speakers of various languages to communicate with the 
device (Martino, Col 1, Lines 36-38). 
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Van Ryzin in view of Martino does not specifically teach a means for displaying a map 
image nor a means for reading map data from a storage medium, however As per claim 9, Ashby 
discloses a navigation system having language-determining means (Col. 19, Lines 6-12), a disk- 
reading device (CD-ROM, Col. 5, Lines 22-25), map reading device (18, FIG. 2, Col. 19, Lines 
33-43), intersection guiding unit (maneuver generation function, 32, FIG. 2), display (27, FIG. 
1), audio unit (29, FIG. 1), and a processor (map control unit) capable of accessing maps in 
memory buffer (RAM, 20, FIG. 1) and non-volatile memory (16, FIG. 1 and 30, FIG. 1). 

Van Ryzin, Martino, and Ashby are analogous art because they are from a similar field of 
endeavor in information providing interface systems. Thus, it would have been obvious to a 
person of ordinary skill in the art, at the time of invention, to modify the teachings of Van Ryzin 
in view of Martino with the map reading means taught by Ashby in order to provide geographic 
map images as additional data in determining an optimum driving route (Ashby, Col 1, Lines 15- 
37; Col 2, Line 61- Col 3, Line 19). 

With respect to Claim 15, Ashby further discloses language-determining means (Col. 19, 
lines 6-12), a map reading device (18, FIG. 2, Col. 19, Lines 33-43), and a processor (map 
control unit) capable of accessing maps in memory buffer (RAM, 20, FIG. 1) and non- volatile 
memory (16, FIG. 1 and 30, FIG. 1). Once a user chooses a specific language, maps and 
maneuver directions will necessarily use the chosen language (Col 19, Lines 35-36). Ashby also 
teaches the client-server environment as applied to Claim 7. 

With respect to Claim 17, Van Ryzin in view of Martino teaches the navigation system 
capable of outputting a road sign image in the language of a user, as applied to Claim 16. Van 
Ryzin in view of Martino does not specifically teach detecting map data in a storage medium in a 
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user's language, however Ashby teaches map data storage means as applied to Claim 15, and 

further discloses searching for map data in a user's specified language (Col. 19, Lines 26-58). 

i 

Van Ryzin, Martino, and Ashby are analogous art because they are from a similar field of 
endeavor in information providing interface systems. Thus, it would have been obvious to a 
person of ordinary skill in the art, at the time of invention, to modify the teachings of Van Ryzin 
in view of Martino with the map reading means taught by Ashby in order to provide multilingual 
support for geographic map images in determining an optimum driving route (Ash by, Col. 1, 
Lines 15-37; Col. 2, Line 61- Col 3, Line 19). 

With respect to Claim 18, Ashby further teaches returning a base language name if there 
is no language entry in the storage means (Col. 19, Lines 26-58). 

With respect to Claim 19, Ashby further discloses language-determining means (Col. 19, 
lines 6-12), a map reading device (18, FIG. 2, Col. 19, Lines 33-43), and a processor (map 
control unit) capable of accessing maps in memory buffer (RAM, 20, FIG. 1) and non- volatile 
memory (16, FIG. 1 and 30, FIG. 1). Once a user chooses a specific language, maps and 
maneuver directions will necessarily use the chosen language (Col. 19, Lines 35-36). Ashby also 
teaches the client-server environment as applied to Claim 7. 

Conclusion 



7. The prior art made of record and not relied upon is considered pertinent to applicants 
disclosure: . 
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Art Unit: 2655 

Morimoto et al (U.S. Patent: 6,018,697)- teaches the use of image recognition and a 
camera in determining the contents of a road sign. 

Teicher (U.S. Patent Publication 2001/0032070)- discloses a means for translating a sign 
into a user language. 

8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to James S. Wozniak whose telephone number is (571) 272-7632 
and email is James.Wozniak@uspto.gov. The examiner can normally be reached on Mondays- 
Fridays, 8:30-4:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Wayne Young can be reached at (571) 272-7582. The fax/phone number for the 
Technology Center 2600 where this application is assigned is (703) 872-9306. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the technology center receptionist whose telephone number is (703) 306- 



0377. 




James S. Wozniak 
6/21/2005 



